A Comprehensive Review of Sound-Based Modalities for Automatic COVID-19 Detection using Deep Learning-Based Techniques

The World Health Organization has labeled the novel coronavirus illness (COVID-19) a pandemic since March 2020. It's a new viral infection with a respiratory tropism that could lead to atypical pneumonia. Thus, according to experts, early detection of the positive cases with people infected by the COVID-19 virus is highly needed. In this manner, patients will be segregated from other individuals, and the infection will not spread. As a result, developing early detection and diagnosis procedures to enable a speedy treatment process and stop the transmission of the virus has become a focus of research. Alternative early-screening approaches have become necessary due to the time-consuming nature of the current testing methodology such as Reverse transcription polymerase chain reaction (RT-PCR) test. The methods for detecting COVID-19 using deep learning (DL) algorithms using sound modality, which have become an active research area in recent years, have been thoroughly reviewed in this work. Although the majority of the newly proposed methods are based on medical images (i.e. X-ray and CT scans), we show in this comprehensive survey that the sound modality can be a good alternative to these methods, providing faster and easiest way to create a database with a high performance. We also present the most popular sound databases proposed for COVID-19 detection. © 2022 IEEE.

Residual Feature Attentional Fusion Network for Lightweight Chest CT Image Super-Resolution

The diagnosis of COVID-19 requires chest computed tomography (CT). High-resolution CT images can provide more diagnostic information to help doctors better diagnose the disease, so it is of clinical importance to study super-resolution (SR) algorithms applied to CT images to improve the reso-lution of CT images. However, most of the existing SR algorithms are studied based on natural images, which are not suitable for medical images;and most of these algorithms improve the reconstruction quality by increasing the network depth, which is not suitable for machines with limited resources. To alleviate these issues, we propose a residual feature attentional fusion network for lightweight chest CT image super-resolution (RFAFN). Specifically, we design a contextual feature extraction block (CFEB) that can extract CT image features more efficiently and accurately than ordinary residual blocks. In addition, we propose a feature-weighted cascading strategy (FWCS) based on attentional feature fusion blocks (AFFB) to utilize the high-frequency detail information extracted by CFEB as much as possible via selectively fusing adjacent level feature information. Finally, we suggest a global hierarchical feature fusion strategy (GHFFS), which can utilize the hierarchical features more effectively than dense concatenation by progressively aggregating the feature information at various levels. Numerous experiments show that our method performs better than most of the state-of-the-art (SOTA) methods on the COVID-19 chest CT dataset. In detail, the peak signal-to-noise ratio (PSNR) is 0.11 dB and 0.47 dB higher on CTtest1 and CTtest2 at x3 SR compared to the suboptimal method, but the number of parameters and multi-adds are reduced by 22K and 0.43G, respectively. Our method can better recover chest CT image quality with fewer computational resources and effectively assist in COVID-19.

Embedded system vehicle based on multi-sensor fusion

As intelligent driving vehicles came out of concept into people’s life, the combination of safe driving and artificial intelligence becomes the new direction of future transportation development. Autonomous driving technology is developing based on control algorithms and model recognitions. In this paper, a cloud-based interconnected multi-sensor fusion autonomous vehicle system is proposed that uses deep learning (YOLOv4) and improved ORB algorithms to identify pedestrians, vehicles, and various traffic signs. A cloud-based interactive system is built to enable vehicle owners to master the situation of their vehicles at any time. In order to meet multiple application of automatic driving vehicles, the environment perception technology of multi-sensor fusion processing has broadened the uses of automatic driving vehicles by being equipped with automatic speech recognition (ASR), vehicle following mode and road patrol mode. These functions enable automatic driving to be used in applications such as agricultural irrigation, road firefighting and contactless delivery under new coronavirus outbreaks. Finally, using the embedded system equipment, an intelligent car was built for experimental verification, and the overall recognition accuracy of the system was over 96%. Author

Improved method for COVID-19 Classification of Complex-Architecture CNN from Chest CT volumes using Orthogonal Ensemble Networks

This paper introduces the improved method for the COVID-19 classification based on computed tomography (CT) volumes using a combination of a complex-architecture convolutional neural network (CNN) and orthogonal ensemble networks (OEN). The novel coronavirus disease reported in 2019 (COVID-19) is still spreading worldwide. Early and accurate diagnosis of COVID-19 is required in such a situation, and the CT scan is an essential examination. Various computer-aided diagnosis (CAD) methods have been developed to assist and accelerate doctors' diagnoses. Although one of the effective methods is ensemble learning, existing methods combine some major models which do not specialize in COVID-19. In this study, we attempted to improve the performance of a CNN for the COVID-19 classification based on chest CT volumes. The CNN model specializes in feature extraction from anisotropic chest CT volumes. We adopt the OEN, an ensemble learning method considering inter-model diversity, to boost its feature extraction ability. For the experiment, We used chest CT volumes of 1283 cases acquired in multiple medical institutions in Japan. The classification result on 257 test cases indicated that the combination could improve the classification performance. © 2023 SPIE.

COVID-19 Detection by Using Handcrafted Features Extracted From Chest CT-Scan Images

Coronavirus illness, which was initially diagnosed in 2019 but has propagated rapidly across the globe, has led to increased fatalities. According to professional physicians who examined chest CT scans, COVID-19 behaves differently than various viral cases of pneumonia. Even though the illness only recently emerged, a number of research investigations have been performed wherein the progression of the disease impacts mostly on the lungs are identified using thoracic CT scans. In this work, automated identification of COVID-19 is used by using machine learning classifier trained on more than 1000+ lung CT Scan images. As a result, immediate diagnosis of COVID-19, which is very much necessary in the opinion of healthcare specialists, is feasible. To improve detection accuracy, the feature extraction method are applied on regions of interests. Feature extraction approaches, including Discrete Wavelet Transform (DWT), Grey Level Cooccurrence Matrix (GLCM), Grey Level Run Length Matrix (GLRLM), and Grey-Level Size Zone Matrix (GLSZM) algorithms are used. Then the classification by using Support Vector Machines (SVM) is used. The classification accuracy is assessed by using precision, specificity, accuracy, sensitivity and F-score measures. Among all feature extraction methods, the GLCM approach has given the optimum classification accuracy of 95.6%. . © 2023 IEEE.

HarDNet and Dual-Code Attention Mechanism based model for medical images segmentation

During the formation of medical images, they are easily disturbed by factors such as acquisition devices and tissue backgrounds, causing problems such as blurred image backgrounds and difficulty in differentiation. In this paper, we combine the HarDNet module and the multi-coding attention mechanism module to optimize the two stages of encoding and decoding to improve the model segmentation performance. In the encoding stage, the HarDNet module extracts medical image feature information to improve the segmentation network operation speed. In the decoding stage, the multi-coding attention module is used to extract both the position feature information and channel feature information of the image to improve the model segmentation effect. Finally, to improve the segmentation accuracy of small targets, the use of Cross Entropy and Dice combination function is proposed as the loss function of this algorithm. The algorithm has experimented on three different types of medical datasets, Kvasir-SEG, ISIC2018, and COVID-19CT. The values of JS were 0.7189, 0.7702, 0.9895, ACC were 0.8964, 0.9491, 0.9965, SENS were 0.7634, 0.8204, 0.9976, PRE were 0.9214, 0.9504, 0.9931. The experimental results showed that the model proposed in this paper achieved excellent segmentation results in all the above evaluation indexes, which can effectively assist doctors to diagnose related diseases quickly and improve the speed of diagnosis and patients’quality of life. Author

LLDSNet: Limited labeled data segmentation network for COVID-19 CT lesion segmentation

With the COVID-19 outbreak in 2019, the world is facing a major crisis and people's health is at serious risk. Accurate segmentation of lesions in CT images can help doctors understand disease infections, prescribe the right medicine and control patients' conditions. Fast and accurate diagnosis not only can make the limited medical resources get reasonable allocation, but also can control the spread of disease, and computer-aided diagnosis can achieve this purpose, so this paper proposes a deep learning segmentation network LLDSNet based on a small amount of data, which is divided into two modules: contextual feature-aware module (CFAM) and shape edge detection module (SEDM). Due to the different morphology of lesions in different CT, lesions with dispersion, small lesion area and background area imbalance, lesion area and normal area boundary blurred, etc. The problem of lesion segmentation in COVID-19 poses a major challenge. The CFAM can effectively extract the overall and local features, and the SEDM can accurately find the edges of the lesion area to segment the lesions in this area. The hybrid loss function is used to avoid the class imbalance problem and improve the overall network performance. It is demonstrated that LLDSNet dice achieves 0.696 for a small number of data sets, and the best performance compared to five currently popular segmentation networks. © 2023 SPIE.

An approach for Face Detection and Face Recognition using OpenCV and Face Recognition Libraries in Python

With the extraordinary growth in images and video data sets, there is a mind-boggling want for programmed understanding and evaluation of data with the assistance of smart frameworks, since physically it is a long way off. Individuals, unlike robots, have a limited capacity to distinguish unexpected expressions. As a result, the programmed face proximity frame- work is important in face identification, appearance recognition, head-present evaluation, human-PC cooperation, and other applications. Software that uses facial recognition for face detection and identification is regarded as biometric. This study converts the mathematical aspects of a person's face into a face print, which is then stored in a database to verify an individual's identification. A deep learning system compares a digital image or an image taken quickly to a previously stored image(which is saved in the database). The face has a significant function in interpersonal communication for identifying oneself. Face recognition technology determines the size and placement of a human face in a digital picture. Facial recognition software has a wide range of uses in the consumer market and in the security and surveillance sectors. The COVID pandemic has brought facial recognition into greater focus lately than ever before. Face detection and recognition play a vital part in security systems that people need to interact with without making physical contact. The pattern of online exam proctoring is employing face detection and recognition. Facial recognition is used in the airline sector to enable rapid, accurate identification and verification at every stage of the passenger trip. In this research, we focused on image quality because it is the major drawback in existing algorithms and used OPEN CV, Face Recognition, and designed algorithms using libraries in python. This study discusses a method for facial recognition along with its implementation and applications. © 2023 IEEE.

TwIdw—A Novel Method for Feature Extraction from Unstructured Texts

Featured ApplicationThe research has a potential application in the field of fake news detection. By using the feature extraction technique, TwIdw, proposed in this paper, more relevant and informative features can be extracted from the text data, which can lead to an enhancement in the accuracy of the classification models employed in these tasks.This research proposes a novel technique for fake news classification using natural language processing (NLP) methods. The proposed technique, TwIdw (Term weight–inverse document weight), is used for feature extraction and is based on TfIdf, with the term frequencies replaced by the depth of the words in documents. The effectiveness of the TwIdw technique is compared to another feature extraction method—basic TfIdf. Classification models were created using the random forest and feedforward neural networks, and within those, three different datasets were used. The feedforward neural network method with the KaiDMML dataset showed an increase in accuracy of up to 3.9%. The random forest method with TwIdw was not as successful as the neural network method and only showed an increase in accuracy with the KaiDMML dataset (1%). The feedforward neural network, on the other hand, showed an increase in accuracy with the TwIdw technique for all datasets. Precision and recall measures also confirmed good results, particularly for the neural network method. The TwIdw technique has the potential to be used in various NLP applications, including fake news classification and other NLP classification problems.

PQSCT: Pseudo-Siamese BERT for Concept Tagging With Both Questions and Solutions

The global outbreak of the new coronavirus epidemic has promoted the development of intelligent education and the utilization of online learning systems. In order to provide students with intelligent services such as cognitive diagnosis and personalized exercises recommendation, a fundamental task is the concept tagging for exercises, which extracts knowledge index structures and knowledge representations for exercises. Unfortunately, to the best of our knowledge, existing tagging approaches based on exercise content either ignore multiple components of exercises, or ignore that exercises may contain multiple concepts. To this end, in this paper, we present a study of concept tagging. First, we propose an improved pre-trained BERT for concept tagging with both questions and solutions (QSCT). Specifically, we design a question-solution prediction task and apply the BERT encoder to combine questions and solutions, ultimately obtaining the final exercise representation through feature augmentation. Then, to further explore the relationship between questions and solutions, we extend the QSCT to a pseudo-siamese BERT for concept tagging with both questions and solutions (PQSCT). We optimize the feature fusion strategy, which integrates five different vector features from local and global into the final exercise representation. Finally, we conduct extensive experiments on real-world datasets, which clearly demonstrate the effectiveness of our proposed models for concept tagging. IEEE

Empirical Review of Various Thermography-based Computer-aided Diagnostic Systems for Multiple Diseases

The lifestyle led by today's generation and its negligence towards health is highly susceptible to various diseases. Developing countries are at a higher risk of mortality due to late-stage presentation, inaccessible diagnosis, and high-cost treatment. Thermography-based technology, aided with machine learning, for screening inflammation in the human body is non-invasive and cost-wise appropriate. It requires very little equipment, especially in rural areas with limited facilities. Recently, Thermography-based monitoring has been deployed worldwide at various organizations and public gathering points as a first measure of screening COVID-19 patients. In this article, we systematically compare the state-of-the-art feature extraction approaches for analyzing thermal patterns in the human body, individually and in combination, on a platform using three publicly available Datasets of medical thermal imaging, four Feature Selection methods, and four well-known Classifiers, and analyze the results. We developed and used a two-level sampling method for training and testing the classification model. Among all the combinations considered, the classification model with Unified Feature-Sets gave the best performance for all the datasets. Also, the experimental results show that the classification accuracy improves considerably with the use of feature selection methods. We obtained the best performance with a features subset of 45, 57, and 39 features (from Unified Feature Set) with a combination of mRMR and SVM for DB-DMR-IR and DB-FOOT-IR and a combination of ReF and RF for DB-THY-IR. Also, we found that for all the feature subsets, the features obtained are relevant, non-redundant, and distinguish normal and abnormal thermal patterns with the accuracy of 94.75% on the DB-DMR-IR dataset, 93.14% on the DB-FOOT-IR dataset, and 92.06% on the DB-THY-IR dataset. [ FROM AUTHOR] Copyright of ACM Transactions on Intelligent Systems & Technology is the property of Association for Computing Machinery and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full . (Copyright applies to all s.)

CCTwins: A Weakly-Supervised Transformer-based Crowd Counting Method with Adaptive Scene Consistency Attention

Recently, crowd counting has attracted significant attention, particularly in the context of the COVID-19 pandemic, due to its ability to automatically provide accurate crowd numbers in images. To address the challenges of location-level labeling, several transformer-based crowd counting methods have been proposed with only count-level supervision. However, these methods directly use the transformer as an encoder without considering the uneven crowd distribution. To address this issue, we propose CCTwins, a novel transformer-based crowd counting method with only count-level supervision. Specifically, we introduce an adaptive scene consistency attention mechanism to enhance the transformer-based model Twins-SVT-L for feature extraction in crowded scenes. Additionally, we design a multi-level weakly-supervised loss function that generates estimated crowd numbers in a coarse-to-fine manner, making it more appropriate for weakly-supervised settings. Moreover, intermediate features supervised by count-level labels are utilized to fuse multi-scale features. Experimental results on four public datasets demonstrate that our proposed method outperforms the state-of-the-art weakly-supervised methods, achieving up to a 16.6% improvement in MAE and up to a 13.8% improvement in RMSE across all evaluation settings. Moreover, the proposed CCTwins obtains competitive counting performance, even when compared to the state-of-the-art fully-supervised methods. IEEE

Learning Strategies for Sensitive Content Detection

Currently, the volume of sensitive content on the Internet, such as pornography and child pornography, and the amount of time that people spend online (especially children) have led to an increase in the distribution of such content (e.g., images of children being sexually abused, real-time videos of such abuse, grooming activities, etc.). It is therefore essential to have effective IT tools that automate the detection and blocking of this type of material, as manual filtering of huge volumes of data is practically impossible. The goal of this study is to carry out a comprehensive review of different learning strategies for the detection of sensitive content available in the literature, from the most conventional techniques to the most cutting-edge deep learning algorithms, highlighting the strengths and weaknesses of each, as well as the datasets used. The performance and scalability of the different strategies proposed in this work depend on the heterogeneity of the dataset, the feature extraction techniques (hashes, visual, audio, etc.) and the learning algorithms. Finally, new lines of research in sensitive-content detection are presented.

Data Mining Techniques for Extraction and Analysis of Covid-19 Data

Artificial intelligence has played a crucial role in medical disease diagnosis. In this research, data mining techniques that included deep learning with different scenarios are presented for extraction and analysis of covid-19 data. The energy of the features is implemented and calculated from the CT scan images. A modified meta-heuristic algorithm is introduced and then used in the suggested way to determine the best and most useful features, which are based on how ants behave. Different patients with different problems are investigated and analyzed. Also, the results are compared with other studies. The results of the proposed method show that the proposed method has higher accuracy than other methods. It is concluded from the results that the most crucial features can be concentrated on during feature selection, which lowers the error rate when separating sick from healthy individuals. © 2022 IEEE.

Robotic Assistance in Radiology: A Covid-19 Scenario

During the COVID-19 Pandemic, the need for rapid and reliable alternative COVID-19 screening methods have motivated the development of learning networks to screen COVID-19 patients based on chest radiography obtained from Chest X-ray (CXR) and Computed Tomography (CT) imaging. Although the effectiveness of developed models have been documented, their adoption in assisting radiologists suffers mainly due to the failure to implement or present any applicable framework. Therefore in this paper, a robotic framework is proposed to aid radiologists in COVID-19 patient screening. Specifically, Transfer learning is employed to first develop two well-known learning networks (GoogleNet and SqueezeNet) to classify positive and negative COVID-19 patients based on chest radiography obtained from Chest X-Ray (CXR) and CT imaging collected from three publicly available repositories. A test accuracy of 90.90%, sensitivity and specificity of 94.70% and 87.20% were obtained respectively for SqueezeNet and a test accuracy of 96.40%, sensitivity and specificity of 95.50% and 97.40% were obtained respectively for GoogleNet. Consequently, to demonstrate the clinical usability of the model, it is deployed on the Softbank NAO-V6 humanoid robot which is a social robot to serve as an assistive platform for radiologists. The strategy is an end-to-end explainable sorting of X-ray images, particularly for COVID-19 patients. Laboratory-based implementation of the overall framework demonstrates the effectiveness of the proposed platform in aiding radiologists in COVID-19 screening. Author

Survey on Healing Herbs Detection using Machine Learning

Nowadays health is very important. All need to take care of their health so that they can prevent diseases and improve their quality of life. The Sanskrit word Ayurveda comprises Science and Knowledge. In simple words, we can say that Ayurveda is the art of living. Medicines can cause hazards to our bodies as well but Ayurveda uses all the natural things for treatment so it is not harmful or dangerous for our bodies. The precise identification of medicinal plants is critical in Ayurvedic medicine. Human specialists use visual characteristics and fragrances to identify plants. Along with leaves flowers and spices are also a vital component in curing diseases. Flowers like lavender, marigold, hibiscus and many more, spices like clove, ginger, cumin, turmeric and so on play crucial role along with their leaves. Covid -19 had very terrible impact on lives of many people. Along with medicines;Ayurveda also played a very important role in curing people. Ayurvedic kadas and many more vanaspatis were used to get rid of this virus, many of the people got rid of this virus at home using home remedies. So, our main aim is to predict the ayurvedic plants that can cure various diseases using machine learning models. © 2023 IEEE.

Prediction of muscular paralysis disease based on hybrid feature extraction with machine learning technique for COVID-19 and post-COVID-19 patients.

Many Coronavirus disease 2019 (COVID-19) and post-COVID-19 patients experience muscle fatigues. Early detection of muscle fatigue and muscular paralysis helps in the diagnosis, prediction, and prevention of COVID-19 and post-COVID-19 patients. Nowadays, the biomedical and clinical domains widely used the electromyography (EMG) signal due to its ability to differentiate various neuromuscular diseases. In general, nerves or muscles and the spinal cord influence numerous neuromuscular disorders. The clinical examination plays a major role in early finding and diagnosis of these diseases; this research study focused on the prediction of muscular paralysis using EMG signals. Machine learning-based diagnosis of the diseases has been widely used due to its efficiency and the hybrid feature extraction (FE) methods with deep learning classifier are used for the muscular paralysis disease prediction. The discrete wavelet transform (DWT) method is applied to decompose the EMG signal and reduce feature degradation. The proposed hybrid FE method consists of Yule-Walker, Burg's method, Renyi entropy, mean absolute value, min-max voltage FE, and other 17 conventional features for prediction of muscular paralysis disease. The hybrid FE method has the advantage of extract the relevant features from the signals and the Relief-F feature selection (FS) method is applied to select the optimal relevant feature for the deep learning classifier. The University of California, Irvine (UCI), EMG-Lower Limb Dataset is used to determine the performance of the proposed classifier. The evaluation shows that the proposed hybrid FE method achieved 88% of precision, while the existing neural network (NN) achieved 65% of precision and the support vector machine (SVM) achieved 35% of precision on whole EMG signal.

Future forecasting prediction of Covid-19 using hybrid deep learning algorithm.

Due the quick spread of coronavirus disease 2019 (COVID-19), identification of that disease, prediction of mortality rate and recovery rate are considered as one of the critical challenges in the whole world. The occurrence of COVID-19 dissemination beyond the world is analyzed in this research and an artificial-intelligence (AI) based deep learning algorithm is suggested to detect positive cases of COVID19 patients, mortality rate and recovery rate using real-world datasets. Initially, the unwanted data like prepositions, links, hashtags etc., are removed using some pre-processing techniques. After that, term frequency inverse-term frequency (TF-IDF) andBag of Words (BoW) techniques are utilized to extract the features from pre-processed dataset. Then, Mayfly Optimization (MO) algorithm is performed to pick the relevant features from the set of features. Finally, two deep learning procedures, ResNet model and GoogleNet model, are hybridized to achieve the prediction process. Our system examines two different kinds of publicly available text datasets to identify COVID-19 disease as well as to predict mortality rate and recovery rate using those datasets. There are four different datasets are taken to analyse the performance, in which the proposed method achieves 97.56% accuracy which is 1.40% greater than Linear Regression (LR) and Multinomial Naive Bayesian (MNB), 3.39% higher than Random Forest (RF) and Stochastic gradient boosting (SGB) as well as 5.32% higher than Decision tree (DT) and Bagging techniques if first dataset. When compared to existing machine learning models, the simulation result indicates that a proposed hybrid deep learning method is valuable in corona virus identification and future mortality forecast study.

An automatic improved facial expression recognition for masked faces.

Automatic facial expression recognition (AFER), sometimes referred to as emotional recognition, is important for socializing. Automatic methods in the past two years faced challenges due to Covid-19 and the vital wearing of a mask. Machine learning techniques tremendously increase the amount of data processed and achieved good results in such AFER to detect emotions; however, those techniques are not designed for masked faces and thus achieved poor recognition. This paper introduces a hybrid convolutional neural network aided by a local binary pattern to extract features in an accurate way, especially for masked faces. The basic seven emotions classified into anger, happiness, sadness, surprise, contempt, disgust, and fear are to be recognized. The proposed method is applied on two datasets: the first represents CK and CK +, while the second represents M-LFW-FER. Obtained results show that emotion recognition with a face mask achieved an accuracy of 70.76% on three emotions. Results are compared to existing techniques and show significant improvement.

A Novel COVID-19 Diagnostic System Using Biosensor Incorporated Artificial Intelligence Technique.

COVID-19, continually developing and raising increasingly significant issues, has impacted human health and caused countless deaths. It is an infectious disease with a high incidence and mortality rate. The spread of the disease is also a significant threat to human health, especially in the developing world. This study suggests a method called shuffle shepherd optimization-based generalized deep convolutional fuzzy network (SSO-GDCFN) to diagnose the COVID-19 disease state, types, and recovered categories. The results show that the accuracy of the proposed method is as high as 99.99%; similarly, precision is 99.98%; sensitivity/recall is 100%; specificity is 95%; kappa is 0.965%; AUC is 0.88%; and MSE is less than 0.07% as well as 25 s. Moreover, the performance of the suggested method has been confirmed by comparison of the simulation results from the proposed approach with those from several traditional techniques. The experimental findings demonstrate strong performance and high accuracy for categorizing COVID-19 stages with minimal reclassifications over the conventional methods.